Interactive Exploration Robots 
a lUlant-labs ne) elelitemexe)if-lelele-latolam-laleMiacclr-leiilelats 


a) 


Terry Fong 


Taxed ite (cla) mace) elo afer mCiaolele) 
NASA Ames Research Center 
terry.fong@nasa.gov 


lO laatclal eats lalsit-laval =>,4e)le)e-lilela 


Jack Schmitt & Lunar Roving Vehicle 
Apollo 17 (December 1972) 
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What's changed since Apollo? 
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Many forms of human-robot teaming 
“Robot as tool” is aie one model 


¢ Humans and robots do not need to 
be just co-located or closely coupled 


> Distributed teaming is also important 
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¢ Human- robot interaction is still slow and 
mismatched (compared to human teams) 


¢ Easy for robots to slow down the human 


> Loosely-coupled teaming (in time and 
space) should also be employed 


Distributed teams 
. Roadie coordination and info exchange 


¢ Require understanding of (and planning for) 
each teammate’s capabilities 
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Humans on Earth Humans on Earth Humans in orbit Real-time 
Robot in space Robot on the Moon Robot on planet telerobotics 
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Space Station In-Flight Maintenance 


Extra-Vehicular Activity (EVA) 
¢ Not enough crew time to do everything 
(only 1-2 EVAs per year) 
¢ Crew must always carry out “Big 12” 
contingency EVA’s if needed 
= Maintain electrical power system 
= Maintain thermal control system 
¢ Prep & tear down: up to 3 hr per EVA 


Intra-Vehicular Activity (IVA) 
¢ Crew spends a lot of IVA time on 
maintenance (40+ hr/month) 
¢ Routine surveys require 12+ hr/month 


= Air quality, lighting, sound level, 
video safety, etc. 


¢ Crew must always carry out 
contingency IVA surveys 
= Find and repair leaks, etc. 
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Space Station Robots 
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Special Purpose Dexterous Manipulator (“Dextre”) 
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Space Station Robots 


Robonaut 2 
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Space Station Interior Survey (2012) 
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Crew: Kevin Ford, Expedition 33 Commander | Pay o1-1-10 | 
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Mars Rovers 


Mars Exploration Rover on Mars 
(artist concept) 


Curiosity at “Big Sky” 
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¢ Characterize the nature and distribution 
of lunar polar volatiles 

¢ Demonstrate in-situ resource 
utilization: process lunar regolith 

¢ Class D / Category 3 Mission 

¢ Launch: ~2021 

¢ Duration: 6-14 Earth days 

¢ Direct-to-Earth communications 

¢ Real-time subsurface prospecting 


¢ Mass: 300 kg (including payload) 
¢ Size: 1.4m x 1.4m x 2m 

¢ Max speed: 10 cm/s 

¢ Speed made good: 0.5 cm/s 
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Real-time Prospecting Field Test (2014) 
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Goals 


¢ Prospecting. Mature prospecting ops concept for NIRVSS and NSS 
instruments in a lunar analog field test 


¢ Real-Time Operations. Improve support software by testing in a setting 
where the abundance / distribution of water is not Known a priori 


¢ Science on Earth. Understand the emplacement and retention of water 
in the Mojave Desert by mapping water distribution / variability 
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Prospecting Rover and Instruments 
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Real-time Operations (NASA Ames) 
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Orion MP 
¢ 60,000 km nevone lunar ide: 
¢ Allows station keeping with minimal fuel 
¢ Crew remotely operates robot 
¢ Does not require human-rated lander 


Human-rol 
¢ Crew emoialy scores surface robot 
from inside flight vehicle 
Crew works in shirt-sleeve environment 

¢ Multiple robot control modes 
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“Fastnet’ Mission Simulation with ISS 


Pre-Mission 
Planning 


Ground teams 
plan out telescope 
deployment and 
initial rover 
traverses. 


Spring 2013 


ISS Expedition 36 


Surveying Telescope Telescope 
stall ll Inspection 


Crew gathers Crew monitors the Crew inspects and 


information needed rover as it deploys documents the 
to finalize the each arm of the deployed telescope 
telescope telescope array. for possible 
deployment plan. damage. 
Chris Cassidy Karen Nyberg 
17 June 2013 26 July 2013 20 August 2013 
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Crew-controlled Telerobotics (2013) 
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Development and Test Facility 


4 Intelligent Robotics Group 
NASA Ames Research Center 
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Assessment Approach 


Metrics 


¢ Mission Success: % task sequences: completed normally, ended abnormally 
or not attempted; % task sequences scheduled vs. unscheduled 


¢ Robot Utilization: % time robot spent on different types of tasks; comparison 
of actual to expected time on; did rover drive expected distance 


¢ Task Success: % task sequences per session and per task sequence: 
completed normally, ended abnormally or not attempted; % that ended 
abnormally vs. unscheduled task sequences 


¢ Contingencies: Mean Time To Intervene, Mean Time Between Interventions 
¢ Robot Performance: expected vs. actual execution time on tasks 


Data Collection 
¢ Data Communication: direction (up/down), message type, total volume, etc. 
¢ Robot Telemetry: position, orientation, power, health, instrument state, etc. 
¢ User Interfaces: mode changes, data input, access to reference data, etc. 
¢ Robot Operations: start, end, duration of planning, monitoring, and analysis 
¢ Crew Questionnaires: workload (Bedford Scale), situation awareness (SAGAT) 
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Real-time Exploration Telerobotics 


Telepresence Remotely Operated Vehicle (TROV) 
¢ Benthic ecology survey of McMurdo Sound (Nov-Dec 1993) 
¢ Remote operations from NASA Ames via satellite (832 kbps downlink) 
¢ Virtual environment + telepresence video (head tracked stereo display) 


B. Hine, C. Stoker, et al. (1994) “The application of telepresence and virtual reality to 
subsea exploration”. Proc. of IARP workshop on mobile robots for subsea environments. 
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Telepresence ROV (1993) 
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Marsokhod at Kilauea 
¢ Geologic mapping of Southwest Desert at Kilauea (Feb 1995) 
¢ Remote operations from NASA Ames via satellite (T1 link) 
¢ Virtual environment + telepresence video (stereo display) 
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Marsokhod at Kilauea (1995) 
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Lessons from TROV & Marsokhod 


Latency 


¢ Latency is only one factor for remote exploration: type of science, 
instruments & data, cost, risk, staffing, robot capabilities, etc. 


¢ Remote (robotic) exploration is not dominated by control latency. Data 
collection (with instruments), analysis (many steps), and decision 
making (strategic and tactical planning) are all far more significant. 


Spatial displays 
¢ 3D visualizations is essential for most field studies 


¢ Head-mounted and stereo video displays are pseudo 3D, not true 3D, 
which leads to many issues (accomodation errors, etc) 


¢ High levels of presence can be achieved even with limited data. 


Real-time telerobotics 
¢ Telepresence (immersive real-time presence) is not a panacea 
¢ Manual control is imprecise and highly coupled to human performance 
(skills, experience, training) 
¢ Minimizing risk is often (far more) important that efficiency. 
oS 
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Intelligent Robotics Group 
Intelligent Systems Division 
NASA Ames Research Center 


irg.arc.nasa.gov 
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